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The purpose of the experiment was to test and evaluate the new PATWAS products, 
schedules, user acceptance, and the effects on the telephone briefing workload at 
the flight service station (FSS). 


In addition, the test permitted the gathering of technical performance data which 
could serve as the basis for a new, consolidated national system for the mass 
dissemination of weather information. It is concluded that the improved PATWAS 
disseminates more weather information, reduces FAA/NWS telephone briefer workloads, 
is preferred over the basic PATWAS, and is acceptable to the general aviation public. 
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INTRODUCTION 


OBJECTIVE. 


As part of the Near Term Flight Service Station Improvement Program, the 
Federal Aviation Administration (FAA), in conjunction with the National 
Weather Service (NWS), conducted a controlled experiment known as the New York 
City (NYC) Pilots Automatic Telephone Weather Answering Service (PATWAS) Test. 
The purpose of the experiment was to test and evaluate new PATWAS products, 
schedules, user acceptance, the effects on the telephone briefing workload at 
the flight service station (FSS), and to gather technical performance data. 


BACKGROUND. 


Prime responsibility for conducting and financing the NYC PATWAS test was 
assigned to the FSS Branch (ARD-440) of the FAA. With technical support from 
the FAA's National Aviation Facilities Experimental Center (NAFEC), ARD~440 
was responsible for the following: 


Le Design, procurement, and installation of system equipment. 


2. Development of a test plan delineating the method of data collection, 
analysis, and interpretation of the results obtained. 


ae Cooperation with the. NWS to assist in the definition of procedures, 
products, and schedules for the test. 


The NWS was responsible for the following: 

1. Detailed operational aspects. 

Ze Weather product design end scheduling. 

3. Manpower required to develop the necessary products and text. 
4. The manual preparation of the recordings. 


The rapid growth in general aviation has made it necessary to improve and 
expand the present system for disseminating aviation weather information to 
the flying public. It is apparent that the projected growth of the flying 
public will give rise to a corresponding increase in the demand for preflight 
weather briefings. One of the most effective techniques currently being 
utilized to disseminate aviation weather information is the telephone-accessed 
prerecorded PATWAS. The purpose of PATWAS is to provide aviation users with 
weather information for preflight planning. 


Operational since July 1975, a trial PATWAS system in the NYC area provides 
telephone access to three tailored independent recordings at three different 
phone numbers. One phone number provides the local New York area (50 nautical 
mile (nmi) radius) conditions. Briefing information for routes northbound is 
available at a second number. The third number provides pertinent information 
for routes south and westbound. Selected Notice to Airmen (NOTAM's) which 
affect flight safety or the use of aeronautical facilities are appended to the 
appropriate recordings. The number of access lines was increased to virtually 
eliminate busy signals. Other improvements included new magnetic tape equip- 
ment, expanded message content, improved message format, more frequent updating 
of information, and reduction in the time required for updating. In order to 
meet the pilot's need for current weather information in the early hours, 
presumably when he is doing his flight planning, two special early morning 
recordings were developed in addition to those prepared in the morning, after- 
noon, and evening. All messages were updated hourly, and if conditions 
demanded, more frequently. The new system contained the capability to request 
meteorological and aeronautical information from the Weather Message Switching 
Center (WMSC) for incorporation into the PATWAS message. 


The trial PATWAS provides the following information: 


Flight precautions, 

Winds aloft, 

Synopsis, 

Area or route forecasts, 

Terminal forecasts, 

Hourly observations from selected locations, and 

NOTAM's pertaining to flight safety or the use of aeronautical facilities 
at these locations. 
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Prior to the installation of the trial PATWAS, the only PATWAS service pro- 
vided in the NYC metropolitan area was that offered by the La Guardia Weather 
Service Office (LGA WSO). This basic PATWAS system provided a two-line access 
for calls originating in the local area (toll-free) and "message unit" toll 
calls from other areas on Long Island. In addition, a foreign exchange line 
provided toll-free access to the same announcement from the Teterboro, 

New Jersey, area. These services remained operational during trial PATWAS 
testing. 


The content of the basic PATWAS message was limited to a generalized forecast 
for New York City and vicinity and a synopsis report. No route information 
was provided, nor hourly weather, specific flight precautions, terminal fore- 
casts, or NOTAM's. AIRMET's were not specific. The message contained only 
general information on wind. No specific heights were included. Recordings 
were updated three times a day. 


Initially, pilots learned of the availability of the new trial PATWAS through 
the basic PATWAS recording, which also remained operational throughout the 
testing period. (The terms "basic" and "trial" PATWAS have been used in lieu of 
"old" and "new'' PATWAS, since the terms "old" and "new" are prejudicial.) 
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The trial PATWAS was evaluated in a number of ways as shown in table 1-l. One 
of the principal methods of evaluation consisted of a questionnaire that was 
mailed to all pilots registered with the General Aviation District Offices 
(GADO's) in Farmingdale, New York, and Teterboro, New Jersey (table 1-2). 
Approximately 26,000 pilots received the questionnaire. The questionnaire was 
designed to measure the degree in which the trial PATWAS satisfied the flight 
planning needs of the respondents and to determine if it constituted a signifi- 
cant improvement over the basic PATWAS. Appropriate follow-up efforts were made 
to obtain an input from nonrespondents to the primary questionnaire. In 
addition, a supplemental survey of 3,152 volunteer pilots was taken to measure 
pilot reaction to the trial PATWAS after recurrent use of the system. It was 
hypothesized that the supplemental survey would provide weightier opinions on 
the acceptability and effectiveness of the trial PATWAS. 


The test procedures and time periods during which they occurred are listed in 
table 1-3. 


TABLE 1l=1. SUMMARY OF DATA COLLECTION METHODS 


Source of data What the Data are 
No. Type Method of Measuring Organization Procedure | Expected to Show Comment 


1 | User No. of completed N.Y. Bell Tel. Co. {| Counter on Increased number of Long term trends 
Acceptance phone calls phone lines calls indicates pi- in demand, 
(Objective) lot acceptance seasonal, and 
since they are weather varia- 
actually using tions must be 
the system more taken into 
account 


User No. briefings PSS. Monthly re- Decrease in number Same as above 
Acceptance,| given per month Supervisors cord of of briefings 

FSS work- (Objective) and Briefers briefings 

load given 


User Questionnaire sent NAFEC contact Mailed ques-| Pilot reactions to 
Acceptance | by FAA (i.e., pilot | pilots tionnaire trial as compared 
opinion) with basic PATWAS, 
(Sub jective) judgement of ac- 
ceptabllity of 
various aspects 


User Post-Flight Con- NAFEC contact Phone and Superiority of trial 
Acceptance tact with pilots mail con- PATWAS as compared 
Stratified Sample tact with with basic; accepta- 
(Subjective) selected bility of changes 
sample of in content, form, 
pilots or format, and 
schedule 


Time on line after Print-out Whether or not Comparison of 

contact from timer "barge-in" is time on line 

(Objective) on line trouplesome with actual mes- 
sage length re- 
veals extent to 
which requester 
listens to more 
than one cycle 
of message 


WSO work- Workload changes W.S.O. Work load One operator can 
load (Subjective) Supervisors determined handle workload so 
and Operators, from super- that there is no 
PATWAS test visory judg-]| increase in per- 
personnel ment, opera-]| sonnel required to 
tor opinion, | operate trial 
and observa- | PATWAS 


tions by test 
personnel 


Equipment / Direct observation NWS Supervisors Expert opin-]| Nature of changes 

procedural (Subjective) and Operators, ion and (if any) required 

adequacy PATWAS test operator in equipment and/ 
personnel judgement or procedures 


TABLE 1-2. COUNTIES OF RESIDENCE AND AIRPORTS INCLUDED IN 
NYC PATWAS TEST 


Counties of Residence* 
New Jersey 
Passaic 
Hunterdon 
Hudson 
Bergen 
Middlesex 
Morris 
Somerset 
Essex 
Union 
Sussex 
Mercer 


Monmouth 


Airports** 


Morristown 
Teterboro 


Newark 


New York 


Queens 
Manhattan 
Brooklyn 
Nassau 
Bronx 
Richmond 
Westchester 
Orange 
Suffolk 
Sullivan 
Rockland 
Putnam 
Dutchess 


Ulster 


La Guardia 

J. F. Kennedy 
Farmingdale 
Islip 


White Plains 


*Included all personnel registered with the General Aviation District Office 


(GADO) at Farmingdale and Teterboro. 


**Includes NYC area airports with FAA control towers. 
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TABLE 1-3. TEST PROCEDURES AND AFFECTED TIME PERIODS 


Time Period 

Starting Ending Test Procedure 

Prior to April 1975 Planning and Design 

April 1975 May 1975 Equipment procurement 

June 1975 July 1975 Equipment installation and checkout 

July 24, 1975 to present Equipment operational 

August 1975 July 1976 Gather 12-month period of data for 
the following activities: PATWAS, 
FSS/WSO briefings, itinerant aircraft 
departures 

November 1975 December 1975 Distribute announcements of test and 
descriptive material 

May 1976 June 1976 Initial distibution of questionnaire 

August 1976 September 1976 Follow-up distribution of questionnaire 

August 1976 August 1976 Distribution of supplementary evalu- 
ative material 

During November 1976 Telephone contact with selected 

nonrespondents 

April 1976 October 1976 Determination of PATWAS message length, 
user time on line, and weather day 

November 30, 1976 Date data collection ended. 


PATWAS CONTACTS, FSS/WSO BRIEFINGS, AND AIRCRAFT OPERATIONS 


This section contains the detailed material upon which the volume I section 
entitled PATWAS CONTACTS AND FSS/WSO BRIEFINGS is based. The information 
presented reflects the summation of various categories of FAA/WSO data and the 
aircraft operations data for the eight airports: Newark, Morristown, Teterboro, 
Farmingdale, White Plains, Islip, JFK, and La Guardia. The detail is presented 
here to facilitate a replication of the analysis and interpretation of the data 
presented in volume I. 


The table 2-1 data for 1971 were derived, since only the total for the year was 
available. January 1970 was also derived, since the actual value was unavail- 
able. The method employed to obtain the missing values by interpolation from 
known data was developed from a discussion in Winer, "Statistical Principles 
in Experimental Design,” McGraw-Hill, 1962, pp. 281-283. Myers, "Fundamentals 
of Experimental Design,"' Allyn and Bacon, 2nd ed., 1972, p. 171 and Goulden 
"Methods of Statistical Analysis," Wiley, 2nd ed., 1952, p. 318 also discuss 
methods of dealing with missing data. Although the source was not employeé in 
this instance, Finn's "A General Model for Multivariate Analysis," Holt, 
Rinehart & Winston, 1974, practice of estimating missing data points without 
specific comment regarding methodology testifies to the general acceptability 
of this device for enhancing the value of a body of data. 


TABLE 2-1. 


NUMBER OF BASIC PATWAS CONTACTS 


Month 1970 


January (2,607) 
February 2,523 
March 2,817 
April 2,528 
May 2,723 
June | 2,888 
July | 3,409 
August | 2,621 
September |} 2,425 
October 2,539 
November | 2,316 
becember_| 2,750 


1971 


(2,856) 
(2,978) 
(3,046) 


(2,687) 
(2,940) 
(3,554) 


(3,323) 
(2,960) 
(2,764) 


(2,553) 
(2,570) 
_(2,768) 


1972 


3,965 
4,101 
3,498 


2,809 
2,868 
4,492 


3,300 
2,723 
3,025 


3,338 
3,685 
3,861 


* All numbers in parentheses are derived. 


1974 


3,279 
3,499 
4,029 


3,571 
3,526 
4,182 


3,926 
4,068 
3,722 


3,013 
2,949 
2,927 


TABLE 2-2. NUMBER OF LA GUARDIA TELEPHONE PILOT BRIEFINGS 


January - 

February = 

March - 

April 1,467 
May 1,614 
June 2,344 
July 1,978 
August 1,648 
September 1,947 
October 1,664 
November 1,860 
December 2,106 


Before 


Trial PATWAS Activation 


TABLE 2-3. 


— ooo 


MeGth 6 ee isis 


January 
February 
March 


April 
May i 
June i 


July 
August 
September 


October 
November 
December 


January 
February 
March 


April 
May 
June 


July 
August 
September 


October 
November 
December 


1970 +=—-:1971 1972 
- 757 722 
- 7166 177 
“i B45 876 
* 711 659 
+ 815 677 
2 883 859 

736 786 568 
626 736 704 
822 753 627 
854 741 632 
715 728 603 
753 895 783 


Before 


NUMBER OF LA GUARDIA PERSONAL PILOT BRIEFINGS 


? 
— 4 


Trial PATWAS Activation 


TABLE 2-4. NUMBER OF ISLIP PILOT BRIEFINGS 


16,775 
15,024 
14,975 


17,959 
19,160 
20,112 


18,861 
18,602 
17,325 


1973 


14,895 
15,060 
17,244 


17,392 
18,445 
19,848 


20,278 
21,090 
15,496 


14,320 
13,664 
12,618 


____ Before 


15,523 
14,357 


13,244 
11,959 
12,/58 


10,286 9, 
11,488 13, 


11,793 13, 


14,812 15, 
17,803 | 16, 


16,999 | 18, 
"74,740 


12,824 
13,446 
12,551 
14,333 


After 


Trial PATWAS Activation 
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920 
175 


759 
508 
602 


391 


TABLE 2-5. NUMBER OF TETERBORO PILOT BRIEFINGS 


Month Se 
\ 1970 1971 1972 1973 1974 1975 1976 
January 11,440 10,668 11,447 10,593 12,340 12,068 | 10,236 
February ' 11,791 10,802 10,238 11,012 11,245 11,412 7,992 
March 14,951 12,137 12,649 12,651 14,375 13,126 | 12,248 
April 13,414 11,732 11,108 11,775 13,317 12,468 | 11,131 
May 16,322 13,239 13,057 14,784 14,889 14,333 | 13,074 
June 15,968 14,447 17,138 16,317 16,969 15,042 | 13,923 
July 16,511 14,844 15,851 15,895 14,878 13,847 | 14,479 
August 14,688 14,153 13,359 16,000 16,057 t = 
September} 13,560 14,987 12,998 13,470 14,855 | 11,458 S 
October 14,656 15,270 12,132 13,260 13,092 |11,962 - 
November 13,368 12,533 12,125 13,106 12,477 ,12,505 — 
December 11,602 11,649 11,884 11,539 11,884 |11,568 - 
Before After 


Trial PATWAS Activation 


TABLE 2-6. NUMBER OF TRIAL PATWAS CONTACTS 


January 


February - 11,882 
March - 12,592 
April = 10,950 
May = 12, 652 
June =) 16,547 
July 1,148 15,031 
August 6,101 - 
September 5,312 - 
October 5,668 - 
November 5,535 me 
December 19,365 - 
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TABLE 2-7. GENERAL AVIATION ITINERANT OPERATIONS 
EWR, MMU, TEB, FRG, HPN, ISP, JFK, LGA 


Month «1970-1972. 972 19731974 = 19751976 
January D252 49,637 48,549 56,784 46,235 49,087 46,546 
February 50,991 47,237 38,444 50,652 45,030 49,948 52,784 
March 61,979 57,744 52,607 51,671 53,367 57,181 59,293 
April 66,213 65,853 60,182 59,330 64,653 64,265 65,483 
May 69,422 66,674 61,308 62,778 66,914 68,434 66,945 
June 69,147 74,294 53,248 57,479 63,620 64,772 66,987 


July 64,597 73,511 65,391 68,089 72,622 67,058 


August 72,004 74,043 68,970 63,608 67,234 67,334 


September 63,511 62,121 56,712 66,477 61,468 625 712 
October 63,174 63,081 655.217 69,574 74,275 70,231 
November 55,363 58,229 53,384 595113 60, 004 66, 600 
December 46,624 52,995 36,866 46,329 51,289 52,038 


TOTAL 734,277 744,959 660,878 711,884 726,711 739,660 358,038 


MULTIVARIATE ANALYSIS OF VARIANCE 
(QUESTION 10--COMPARISON BETWEEN BASIC PATWAS AND TRIAL PATWAS) 


This section contains the results of the multivariate analysis of variance 
of question 10 using the responses from the initial and follow-up returns. 
The highlights of the findings are presented in the volume I section entitled 
PILOT SURVEY. 
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MULTIVARIATE ANALYSIS OF VARIANCE 
(QUESTION 8--REACTION TO TRIAL PATWAS) 


This section contains the results of the multivariate analysis of variance of 
question 8 using the responses from the initial and follow-up returns. The 
highlights of the findings are presented in the volume I section entitled 
PILOT SURVEY. 
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FSS CONTACT 
PRE-FLIGHT AND IN-FLIGHT 


This section presents the question 9 data obtained from the initial, follow-up, 
and supplementary survey returns of the primary questionnaire. 


The material is discussed in volume I subsections under PILOT SURVEY entitled 
FSS CONTACT REDUCED and FSS CONTACT LENGTH. 
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SUPPLEMENTAL SURVEY 


The primary questionnaire asked for volunteers who wished to participate in 4 
follow-up survey. A summary of the results obtained from these returns is 
presented here. The material relates to the volume I discussion entitled 


SUPPLEMENTAL SURVEY. 
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TELEPHONE ACTIVITY 


Various measures-of telephone activity were obtained and correlated with FSS 
observations of actual weather. The raw and partially processed data are 
presented in various segments on the following pages. The material is 
discussed in volume I section entitled TELEPHONE ACTIVITY. 
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mailings are contained in this section. The material is discussed in 
volume I. 
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QUESTIONNAIRE DATA (INITIAL) 


The questionnaire data obtained from responses to the initial mailing are 
contained in this section. The material is discussed in volume I. 
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QUESTIONNAIRE DATA (FOLLOW-UP) 


The questionnaire data obtained from responses to the follow-up mailing are 
contained in this section. The material is discussed in volume I. 
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QUESTIONNAIRE DATA (SUPPLEMENTAL) 


The questionnaire data obtained from responses to the supplemental survey are 
contained in this section. The material is discussed in volume I. 
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